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DESCRIPTION 
IMAGE PROCESSING APPARATUS AND METHOD 

TECHNICAL FIELD 
5 The present Invention relates to an Image 

processing apparatus and method and, for example, to ar 
image process for processing image data between image 
input /output devices. 

10 BACKGROUND ART 

Along with the popularization of personal 
computers, it has become easy to input an image by an 
image input device such as a digital camera, color 
scanner, or the like, to display and confirm that image 
15 using an image display device such as a CRT, LCD, or 
the like, to apply an edit process, modification 
process, retouching process, and the like to the image 
in accordance with the intended purpose, and to output 
the image using an image output device such as a color 
20 printer or the like. Also, an image sensed by a 

digital camera is often directly output from a color 
printer without being displayed on a color monitor. Of 
course, when a CG image created on a computer is output 
by a color printer, no image input device is required. 
25 Image input/output devices such as a digital 

camera, color scanner, color monitor, color printer, 
and the like have different color reproduction 
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characteristics and ranges. In order to match color 
reproduction between image Input/output devices, a 
standard color space is used as a color space to 
exchange color signals between devices to execute a 
5 color process that places an importance on gradation 

(tincture), vividness, color difference, or the like in 
correspondence with the input/output purpose or 
application of an image . 

As a standard color space used to exchange color 
10 signals between devices, sRGB as a monitor color space 
is known. The gamut of the sRGB color space is 
narrower than that of an ink- jet printer. As standard 
color spaces having broader gamuts, sYCC, bg-sRGB, 
scRGB, and the like are known. However, these color 
15 spaces have broad gamuts beyond the human visible range 
(visual limit range) , but do not define handling of 
data outside the visual limit range. 

The human visible range (visual limit range) 
indicates a region in the xy chromatid ty diagram, 
20 which is surrounded in a spectrum locus and a purple 
boundary, and Indicates a color reproduction range 
which is a visible range of the human. 

As for handling of data outside a gamut, Japanese 
Patent Laid-Open No. 4-186969 discloses an example 
25 wherein when a color outside the gamut of an image 

output device is input, color conversion that attaches 
an importance on color differences and converts the 
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input color Into a color which is closest to the Input 
color (I.e., a color having a minimum color difference) 
within the gamut of the image output device is 
executed. However, the technique disclosed in this 
5 reference not only does not check whether the input 
color falls inside or outside the visual limit range, 
but also does not consider the tincture of original 
input data since that technique simply converts a color 
outside the gamut of the image output device into a 
10 color having a minimum color difference. 

As for handling of extended- gamut digital image 
data, Japanese Patent Laid-Open No. 2002-27275 obtains 
a digital image of a preservation space by adjusting 
the color value of an extended- gamut digital image to 
15 fall within a limited gamut, and expressing the 

limited-gamut digital image within a preservation color 
space. Then, this technique determines a residual 
image that indicates the difference between the 
extended- gamut digital image and limited-gamut digital 
20 image to associate them with the digital image of the 
preservation space. However, in the contents of 
Japanese Patent Laid-Open No. 2002-27275, a 
preservation image and residual image are used to 
preserve a target image, and how to handle color space 
25 in an image process between color input/output devices 
that handle a color image with a broad gamut is not 
specified . 
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DISCLOSURE OP INVENTION 
The present invention has been made to solve the 
aforementioned problems individually or together, and 
5 has as its object to appropriately handle image data 
outside a gamut. 

It is another object of the present invention to 
allow to set color conversion in consideration of the 
tincture of image data outside a gamut . 
10 In °^der to achieve the above objects, a 

preferred embodiment of the present invention discloses 
an image processing method of processing image data 
between devices which input /output an image, comprising 
the steps of: inputting image data; determining 
15 whether or not the input image data falls outside the 
human visible range; and converting the image data 
which is determined to fall outside the range to a 
color on an inf ramarglnal portion of or inside the 
range . 

20 Xt is st±11 another object of the present 

invention to allow a color image process which 
independently uses a color expression space and a color 
space for a color conversion process upon exchanging 
image data between color image input/output devices or 
upon executing image processes such as color conversion 
and the like. 

In order to achieve the above object, a preferred 



25 
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embodiment of the present invention discloses an image 
processing method, comprising the steps of: inputting 
a color data represented by a first color space which 
includes the human visible range; converting the input 
5 color data into a second color space for a color 

conversion process which includes a gamut of a first 
device; performing the color conversion process on the 
color data converted into the second color space; and 
converting the color data, which has undergone the 
10 color conversion process, into the first color space, 
and outputting the color data converted into the first 
color space . 

Other features and merits of the present 
invention will be apparent from the following 
15 description taken in conjunction with the accompanying 
drawings . 

BRIEF DESCRIPTION OF DRAWINGS 
The accompanying drawings, which are incorporated 
20 in and constitute a part of the specification, 

illustrate embodiments of the invention and, together 
with the descriptions, serve to explain the principle 
of the invention. 

Fig. 1 is a block diagram showing the arrangement 
25 of an image processing apparatus according to an 
embodiment; 

Fig. 2 is a flow chart showing an image process 
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Fig. 3 Is a flow chart showing a process for 
reading visual limit range information; 

Figs . 4A and 4B show an example of visual limit 
5 range information stored in a visual limit range 
storage unit ; 

Fig. 5 is a flow chart showing a process for 
determining whether a color falls inside or outside a 
visual limit range; 
10 Fig. 6 is a flow chart showing a color conversion 

process; 

Fig. 7 shows a color conversion method setup 
window as a user interface window used to set a color 
conversion method; 
15 Fig. 8 is a graph for explaining the color 

conversion method; 

Fig. 9 is a block diagram showing the arrangement 
of an image processing apparatus according to the 
second embodiment ; 
20 Fig. 10 is a flow chart showing an image process 

of the image processing apparatus; 

Fig. 11 is a flow chart showing a process for 
reading internal process gamut information; 

Figs. 12A and 12B show an example of internal 
25 process gamut information, which is stored in an 
internal process gamut storage unit; 

Fig. 13 is a flow chart showing a process for 
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determining whether a color falls inside or outside an 
internal process gamut; 

Fig. 14 is a flow chart showing a color 
conversion process; 
5 Fig. 15 is a block diagram showing the 

arrangement of an image processing apparatus according 
to the third embodiment; 

Fig. 16 is a flow chart showing an image process 
of the image processing apparatus; 
!0 Fig. 17 is a flow chart showing a process for 

mapping an internal process gamut to the gamut of an 
image output device; 

Figs. 18A to 18D are block diagrams of an image 
processing apparatus according to the fourth 
15 embodiment; 

Fig. 19 is a flow chart for explaining the flow 
of processes in the image processing apparatus of the 
fourth embodiment; 

Fig. 20 is a flow chart for explaining the flow 
20 of processes in an input-side image processing 
apparatus of the fourth embodiment; 

Fig. 21 is a flow chart for explaining the flow 
of processes in a display- side image processing 
apparatus of the fourth embodiment; 
25 Fig. 22 is a flow chart for explaining the flow 

of processes in an output -side image processing 
apparatus of the fourth embodiment; 
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Fig. 23 is a flow chart for explaining a range 
information read process of a color conversion work 
space ; 

Fig. 24 is a flow chart for explaining a process 
for determining whether a color falls inside or outside 
the color conversion work space range; 

Fig. 25 is a flow chart for explaining a color 
conversion process into the color conversion work 
space ; 

Fig. 26 is a view for explaining the color 
conversion process ; 

Figs. 27A and 27B show an example of color 
conversion work space range information; 

Fig. 28 is a block diagram of an image processing 
15 apparatus according to the fifth embodiment; 

Fig. 29 is a flow chart for explaining the flow 
of processes in the image processing apparatus of the 
fifth embodiment; 

Figs. 30A to 30D are block diagrams of an image 
20 processing apparatus according to the sixth embodiment; 

Fig. 31 is a flow chart for explaining the flow 
of processes in the image processing apparatus of the 

sixth embodiment; 

Fig. 32 shows an example of a user interface in 
25 the image processing apparatus of the sixth embodiment; 
and 

Fig. 33 shows an example of image data in the 
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seventh embodiment. 

BEST MODE FOR CARRYING OUT THE INVENTION 
An image processing apparatus and method 
5 according to preferred embodiments of the present 

invention will be described in detail hereinafter with 
reference to the accompanying drawings . 

First Embodiment 
10 [Arrangement] 

Fig. 1 is a block diagram showing the arrangement 
of an image processing apparatus 1 of this embodiment. 

To the image processing apparatus 1, an image 
input device 2 such as a digital camera, color scanner, 
15 or the like for inputting an image, an image display 

device 3 such as a CRT, LCD, or the like for displaying 
an image , and an image output device 4 such as a color 
printer or the like for outputting an image are 
connected. 

20 In the image processing apparatus 1, an image 

input unit 5 is an interface such as a USB, IEEE1394, 
or the like, which inputs a color signal from the image 
input device 2. An image display unit 6 is a video 
interface which generates a color signal to be 

25 displayed on the image display device 3. An image 

output unit 7 is an interface such as IEEE1284, USB, 
IEEE1394, or the like, which outputs a color signal to 
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the Image output device 4. 

In an RGB space such as scRGB, which can express 
a value beyond the visual limit range , digital data 
such as computer graphics data or the like can be 
5 generated irrespective of whether or not it falls 

within the visual limit range, and often exceeds the 
visual limit range. Also, in an RGB space such as 
scRGB, which can express a value beyond the visual 
limit range, when image data which falls within the 
10 visual limit range undergoes a process such as an edge 
emphasis process , saturation-up process, or the like, 
which increases the saturation or lightness of pixels, 
the processed image data may often exceed the visual 
limit range. 

15 a color coordinate conversion unit 8 converts 

color signal coordinates (color space) among an input 
color signal, display color signal, output color 
signal, and processed color signal. A gamut 
inside/outside determination unit 9 determines if an 

20 input color signal indicates a color inside or outside 
the visual limit range. A color conversion unit 10 
converts a color signal corresponding to a color 
outside the visual limit range into a color of an 
inframarginal portion of the visual limit range. 

25 A data buffer 11 is a memory such as a RAM or the 

like, which temporarily saves data for data processes. 
A visual limit range storage unit 12 is a nonvolatile 
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memory such as a ROM, hard disk, or the like, which 
stores the visual limit range in a state wherein the Y 
values of XYZ values of black and white are normalized 
to 0 to 1 , and also stores LCh values or RGB values as 
5 a three-dimensional (3D) range. 

A user interface (Ul) unit 13 is an interface 
which allows the user to operate the image processing 
apparatus 1 . Note that an interface window generated 
by the UI unit 13 is displayed on the image display 
10 device 3 via the image display unit 3. User's 

operations on the interface window are input to the UI 
unit 13 via a keyboard and pointing device (not shown). 

Note that the color coordinate conversion unit 8 
gamut inside/outside determination unit 9, color 
15 conversion unit 10, and UI unit 13 are implemented by 
supplying a program to a CPU (not shown) of the image 
processing apparatus 1 although they may be implemented 
by hardware. 
[Processing] 

20 Fig. 2 is a flow chart showing the image process 

of the image processing apparatus 1. This image 
process is executed by the CPU of the image processing 
apparatus 1. 

When image data is input from the image input 

25 device 2 via the image input unit 5, the image data is 
written in the data buffer 11 <S201). The input image 
data undergoes color coordinate conversion into XYZ 
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values by the color coordinate conversion unit 8 
(S202). In this embodiment, scRGB is used as color 
coordinate values of the input image data. Therefore, 
color coordinate conversion in step S202 uses: 
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Visual limit range information is read out from 

10 the visual limit range storage unit 12 (S203), and the 
gamut inside /out side determination unit 9 determines 
whether the image data which has undergone the color 
coordinate conversion falls inside or outside the 
visual limit range (S204). If the determination result 

15 indicates that the image data falls within the visual 
limit range, the flow jumps to step S207; otherwise, 
the flow advances to step S206 (S205). 

If it is determined that the image data falls 
outside the visual limit range, the color conversion 

20 unit 10 converts that image data into Image data 

corresponding to a color of an inframarginal portion of 
the visual limit range, and writes the converted data 
at a corresponding location on the data buffer 11 
(S206). It is then determined if image data to be 

25 processed corresponds to the last pixel of the input 
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image data (S207) . If the image data to be processed 

does not correspond to the last pixel, the flow returns 

* * ■ ■ - 

to step S204. 

If the image data corresponds to the last pixel, 

5 the color coordinate conversion unit 8 executes color 
coordinate conversion of the image data stored in the 
data buffer 11 from XYZ values into output color signal 
coordinate values (S2 08) . In this embodiment, scRGB is 
used as output color coordinate values. Therefore, the 

0 color coordinate conversion uses: 
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The image data stored in the data buffer 11 is 
output to the image display device 3 or image output 
device 4 via the image display unit 6 or image output 
unit 7 (S209), thus ending the process. 
[Visual Limit Range Information] 

Fig. 3 is a flow chart showing the process for 
reading the visual limit range information in step 
S203. 

The XYZ values of black as the lower limit of the 
visual limit range are read from the visual limit range 
storage unit 12, and are set in registers Xk, Yk, and 



WO 2004/028143 PCT/JP2003/611047 

- 14 - 

Zk (S301) . Likewise/ the XYZ values of white as the 
upper limit of the visual limit range are read, and are 
set in registers Xw, Yw, and Zw (S302). Next, 3D 
information (LCh values) of the visual limit range are 
5 read (S303), thus ending the process. 

Figs. 4A and 4B show an example of the visual 
limit range information stored in the visual limit 
range storage unit 12, and respectively show the XYZ 
values of black information and white information of 
10 the visual limit range (Fig. 4A) and the LCh values of 
3D information of the visual limit range (Fig. 4B). 
For example, black information is expressed by X - 0.0, 
Y « 0.0, and Z = 0.0, and white information is 
expressed by X = 95.05, Y = 100.0, and Z = 108.91 in 
15 case of a D65 light source. As the 3D information, 
equations (5.1) to (5.4) (using D65 as white) and 
equation (6) are used to calculate LCh values based on 
XYZ values ranging from (0.0, 0.0, 0.0) to (95/05, 
100.0, 108.91) and, for example, C values corresponding 
20 to maximum saturation levels in 10-step increments of L 
and h values are stored. 

[Inside/outside Determination of Visual Limit Range] 

Fig. 5 is a flow chart showing a process for 
determining whether a color falls inside or outside the 
25 visual limit range in step S204. 

A gamut inside/outside determination flag OUT is 
initialized (S401), and it is checked if an X value of 
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image data is smaller than the lower limit value Xk of 
the visual limit range (S402). Likewise, it is 
sequentially checked if a Y value is smaller than the 
lower limit value Yk (S403), if a Z value is smaller 
5 than the lower limit value Zk, if the X value is larger 
than the upper limit value Xw of the visual limit range 
(S405), if the Y value is larger than the upper limit 
value Yw (S406), and if the Z value is larger than the 
upper limit value Zw (S407). If it is determined in 
10 any of these steps that the value of interest is 

smaller than the lower limit value or is larger than 
the upper limit value, the flow advances to step S408; 
otherwise, the process ends. 

If it is determined in any of these steps that 
15 the value of interest is smaller than the lower limit 
value or is larger than the upper limit value, '1' 
indicating outside the gamut is set in the gamut 
inside/outside determination flag OUT (S408), thus 
ending the process. 
20 [Color Conversion] 

Fig. 6 is a flow chart showing the color 
conversion process in step S206, Fig. 7 shows a color 
conversion method setup window 601 as a user interface 
window used to set a color conversion method, and 
25 Fig. 8 is a graph for explaining the color conversion 
method. 

Since the calculation results of the above 



WO 2004/028143 



- 16 - 



PCT/JP2003/011047 



equations are scaled so that Y falls within the range 
from 0 to 1, XYZ values are respectively multiplied by 
100 to adjust the scale (S501), and the color 
Conversion unit 8 converts the XYZ values into Lab 
5 values (S502) by: 

if Y/Yn > 0.56, 

L* = 116(Y/Yn) 1/3 ...(5.1) 
if Y/Yn s 0.56, 

L*= 903. 29 (Y/Yn) ...(5.2) 
10 where Y: the Y value. of a tristimulus value on the XYZ 
color system 

Yn: the Y value based on standard light of a 
perfect reflecting diffuser 

a* - 500[f(X/Xn) - f(Y/Yn)] 
15 b* = 200[f(X/Xn) - f(Z/Zn)] ...(5.3) 

for 

if X/Xn > 0.56, 
f (X/Xn) (X/Xn) 1/3 
if X/Xn is 0.56. 
20 f(X/Xn) = 7.78(X/Xn) + 16/116 

if Y/Yn > 0.56. 

f(Y/Yn) = (Y/Yn) 1 ' 3 ...(5.4) 
if Y/Yn ss 0.56, 
f(Y/Yri) - 7.78(Y/Yn) + 16/116 
25 If Z/Zn > 0.56, 

f(Z/Zn) - (Z/Zn) 1/3 
if Z/Zn s 0.56, 
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f(Z/Zn) « 7.78(Z/Zn) + 16/116 

where 

X, Y, and Z: tristlmulus values X, Y, Z on the 
XYZ color system 

Xn, Yn, and Zn: X, Y, and Z values based on 
standard light of the perfect reflecting diffuser 

Note that the conversion in step S502 uses Xn - 
95.05, Yn = 100.0, and Zn = 108.91 since D65 is used as 
white. Next, the color coordinate conversion unit 8 
converts the Lab values into LCh values (S503) using: 
L = L* 

= Via* 2 + b* 2 ) ...(6) 
h ab - tan^(b*/a*) 

A user interface shown in Fig. 7 is presented to 
15 make the user set a color conversion method (S504). A 
color conversion method setup window 601 includes a 
basic setup window 602 used to select a basic color 
conversion method. When the user wants to set the 
color conversion method in more detail (to set a 
20 preferential conversion method in addition to the basic 
setup), he or she checks a detailed setup check box 603 
and selects a preferential conversion condition using 
radio buttons on a detailed setup window 604. Note 
that "hue preservation" is selected as basic color 
25 conversion, and "gradation preference" is selected as 
the conversion condition in the example of Pig. 7. 

Upon completion of the setups, the user presses 
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an "OK" button 605. If the user wants to cancel the 
setups, he or she presses a "cancel" button 606. 

The color conversion un±t 10 executes color 
conversion in accordance with the set color conversion 
5 method (and conversion condition) (S505). Fig. 8 shows 
the color conversion executed in step S505, and shows a 
color conversion direction when "hue preservation" is 
selected as the basic color conversion method. Note 
that the ordinate plots lightness L, and the abscissa 

10 plots saturation C and also a visual limit range 700 
read in step S303. 

In Fig. 8, when "saturation preference" is 
selected, an input color 701 is converted into a color 
on an inframarglnal portion 702 of the visual limit 

15 range 7.00 so as not to change saturation. Likewise, 
when "color difference preference" is selected , the 
input color 701 is converted into a color on an 
inframarglnal portion 703 so as to minimize the color 
difference; when "gradation preference" is selected, 

20 the input color 701 is converted into a color on an 
inframarglnal portion 704 so as not to change 
gradation; or when "lightness preference" is selected, 
the input color 701 is converted into a color on an 
inframarglnal portion 705 so as not to change 

25 lightness. 

The color coordinate conversion unit 8 converts 
the LCh values that have undergone the color conversion 
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into Lab values using an inverse conversion equation of 
equation (6) (S506), converts the Lab values into XYZ 
values using inverse conversion equations of equations 
(5.1) to (5.4) (S507), and divides the XYZ values by 
5 100 to set the original scale (S508), thus ending the 
process . . 

As described above, it is checked using black 
information and white information of the visual limit 
range whether or not input color data falls Inside or 

10 outside the visual limit range , and color data outside 
the visual limit range undergoes color conversion in 
accordance with the conversion method (and conversion 
condition) set by the user. Hence, the color outside 
the visual limit range can be converted into a color on 

15 the inframarginal portion of the visual limit range 
while preserving tincture or the like as much as 
possible. 

Mapping into the visual limit range is required 
to convert a pixel having a color outside the visual 

20 limit range into that having a color inside the visual 
limit range, since image data must be finally visually 
observed by a person. If mapping of the first 
embodiment is not made, since a conversion destination 
within the visual limit range of a color outside the 

25 visual limit range is unknown, that color alone is 

converted into a different color, and connection with 
surrounding pixels deteriorates, thus considerably 
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impairing the Image quality. When the color conversion 
process of gradation-preferential hue preservation is 
executed like in the first embodiment, a color outside 
the visual limit range is processed so as not to change 
5 its tincture as much as possible. Hence, connection 
with surrounding pixels can be prevented from 
deteriorating . 

Second Embodiment 

10 An image processing apparatus according to the 

second embodiment of the present invention will be 
described below. Note that the same reference numerals 
in the second embodiment denote the same parts as in 
the first embodiment , and a detailed description 

15 thereof will be omitted. 
[Arrangement] 

Fig. 9 is a block diagram showing the arrangement 
of the image processing apparatus 1 of the second 
embodiment . 

20 An internal process gamut storage unit 14 is a 

nonvolatile memory such as a ROM, hard disk, or the 
like, which stores an internal process gamut having 
three, R, G, and B points as vertices. Note that the 
internal process gamut storage unit 14 stores the RGB 

25 values of black and white, which are normalized to 0 to 
1, as will be described in detail later. Also, the 
unit 14 stores LCh values as a 3D range. 
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[Processing] 

Fig. 10 is a flow chart showing the image process 
of the image processing apparatus 1. This image 
process is executed by the CPU of the Image processing 

5 apparatus 1. 

When image data is input from the image input 
device 2 via the image input unit 5, the image data is 
written in the data buffer 11 /( 81201) . The input image 
data undergoes color coordinate conversion into 
10 internal process RGB values via XYZ values by the color 
coordinate conversion unit 8 (S1202). In this 
embodiment, scRGB is used as color coordinate values of 
the input image data. Therefore, color coordinate 
conversion in step S1202 uses equations (1) and (2), 
15 and: 

rj?l r/i11 all al31Pn 
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Note that the converted RGB value may undergo a gamma 
conversion process as needed. 

Gamut information of an internal process color 
signal is read out from the internal process gamut 
storage unit 14 (S1203). and the gamut inside /out side 
determination unit 9 determines whether the image data 
which has undergone the color coordinate conversion 
falls inside or outside the internal process gamut 
(S1204). If the determination result indicates that 
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I" 6 ^ **' f " 1S «" Vernal process gamut 

9 "° W 3mWS t0 «** otherwise, the flow ' 

advances to step S1206 (S1205) . 

" It ts determined thet the image date falls 
5 outside the kernel process gamut ^ ooior 

coupon 10 converts ^ ^ ^ ^ ^ 

Ante corresponding to a color „f as Inframarginal 
Portion of the internal process gamut, and writes the 
converted data at a corresponding location on the data 
buffer 11 (S1206) . It u ^ aetenninea ^ ■ 

to be processed corresponds to the last pi«l of the 

input image data (S l 207) . « the ^ 

Processed does not correspond to the last pix el. the 

flow returns to step S1204. 

« the Imege data corresponds to the last pi^el. 
the i^ge aa ta stored in the data tet6r „ is output 

to the Image display device 1 < 

y oevloe 3 or Image output device 4 
via the Image display unit R < 

p * 6 or image output unit 7 

(S1208). thus ending the process. 

[Internel Process Gamut Information] 

"9. 11 is a flow chart showing the process f„ r 
reading the internal process gamut information in step 

The RGB values of hlao* as the lower limit of the 
internal process gamut are read from the Internal 
Process gamut storage unit 12. end are set in registers 
<3C ' Md Bk (S " 01 '- «»~±~. the RGB values of 
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white as the upper limit of the internal process gamut 
are read, and are set in registers Rw, Gw, and Bw 
(S1302). Next, 3D information (LCh values) of the 
internal process gamut are read (S1303), thus ending 
5 the process. 

Figs. 12A and 12B show an example of the internal 
process gamut information stored in the internal 
process gamut storage unit 14 , and respectively show 
the RGB values of black information and white 

10 information of the internal process gamut (Fig. 12A) 
and the LCh values of 3D information of the internal 
process gamut (Fig. 12B) . For example , black 
information is expressed by R = 0.0, B « 0.0, and B = 
0.0, and white information is expressed by R = 1.0, G = 

15 1.0, and B = 1.0. As the 3D information, after XYZ 

values obtained by inverse conversion of eguation (7) 
using the RGB values ranging from (0.0,0.0, 0.0) to 
(1.0, 1.0, 1.0) are multiplied by 100, equations (5.1) 
to (5.4) (using D65 as white) and eguation (6) are used 

20 to calculate LCh values based on those XYZ values and, 
for example, C values corresponding to maximum 
saturation levels in 10 -step increments of L and h 
values are stored. 

[Inside/outside Determination of Internal Process 
25 Gamut] 

Fig. 13 is a flow chart showing the .process for 
determining whether a color falls inside or outside an 
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internal process gamut in step S1204. 

A gamut inside/outside determination flag OUT is 
initialized (S1401), and it is checked if an R value of 
image data is smaller than the lower limit value Rk of 
5 the internal process gamut (S1402). Likewise, it is 
sequentially checked if a G value is smaller than the 
lower limit value Gk (S1403), if a B value is smaller 
than the lower limit value Bk, if the R value is larger 
than the upper limit value Rw of the internal process 
10 gamut (S1405), if the G value is larger than the upper 
limit value Gw (S1406) . and if the B value is larger 
than the upper limit value Bw (S1407). If it is 
determined in any of these steps that the value of 
interest is smaller than the lower limit value or is 
15 larger than the upper limit value, the flow advances to 
step S1408; otherwise, the process ends. 

If it is determined in any of these steps that 
the value of interest is smaller than the lower limit 
value or is larger than the upper limit value, 'l' 
20 indicating outside the gamut is set in the gamut 

inside/outside determination flag OUT (S1408), thus 
ending the process. 
[Color Conversion] 

Fig . 14 is a flow chart showing the color 
25 conversion process in step S1206. 

The color coordinate conversion unit 8 converts 
the RGB values of the internal process color signal 
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into XYZ values using the inverse conversion equation 
of equation (7) (S1501). As in the first embodiment, 
since the calculation results of the above equations 
are scaled so that Y falls within the range from 0 to 
5 1, XYZ values are respectively multiplied by 100 to 

adjust the scale (S1502), and the color conversion unit 
8 converts the XYZ values into Lab values using 
equations (5.1) to (5.4) (S1503). Note that the 
conversion ±n step S1503 uses Rn = 95.05, Gn = 100.0, 
10 and Bn - 108.91 since D65 is used as white. 

Next, the color coordinate conversion unit 8 
converts the Lab values into LCh values using equation 
(6) (S1504), and the user interface shown in Fig. 7 is 
presented to make the user set a color conversion 
15 method (S1505). Then, the color conversion unit 10 
executes color conversion in accordance with the set 
color conversion method (S1506). 

The color coordinate conversion unit 8 converts 
the LCh values that have undergone the color conversion 
20 into Lab values using an Inverse conversion equation of 
equation (6) (S1507), converts the Lab values into XYZ 
values using inverse conversion equations of equations 
(5.1) to (5.4) (S1508), and divides the XYZ values by 
100 to set the original scale (S1509). 
25 Finally, the color coordinate conversion unit 8 

converts the XYZ values into RGB values of the internal 
process color signal using equation (7), thus ending 
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the process 

In this manner, it is determined using black 
information and white information of the internal 
process gamut whether input color data falls inside or 
outside the internal process gamut , and the color data 
which falls outside the internal process gamut 
undergoes color conversion in accordance with the 
conversion method (and conversion condition) set by the 
user. Hence, a color that falls outside the internal 
process gamut can be. converted into a color on the 
inframarginal portion of the internal process gamut 
while preserving its tincture as much as possible. 

Third Embodiment 

An image processing apparatus according to the 
third embodiment of the present invention will be 
described below. Note that the same reference numerals 
in the third embodiment denote the same parts as in the 
first embodiment, and a detailed description thereof 
20 will be omitted. 
[Arrangement ] 

Fig. 15 is a block diagram showing the 
arrangement of the image processing apparatus 1 of the 
third embodiment. 
25 An image processing unit 15 executes image 

processes such as color correction and the like. A 
gamut mapping unit 16 maps the internal process gamut 
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to the gamut of the image output device 4. An image 
output device gamut storage unit 17 stores LCh values 
as a 3D range, i.e., the gamut of the image output 
device 4, as will be described in detail later. 
5 [Processing] 

Fig. 16 is a flow chart showing the image process 
of the image processing apparatus 1. This image 
process is executed by the CPU of the image processing 
apparatus 1. 

10 When image data is input from the image input 

device 2 via the image input unit 5, the image data is 
written in the data buffer 11 (S2201). The input image 
data undergoes color coordinate conversion into 
internal process RGB values via XYZ values by the color 
15 coordinate conversion unit 8 (S2202). In this 

embodiment, scRGB is used as color coordinate values of 
the input image data. Therefore, color coordinate 
conversion in step S2202 uses equations (1), (2), and 
(7). Note that the converted RGB value may undergo a 
20 gamma conversion process as needed. 

As in the second embodiment, gamut information of 
an internal process color signal is read out from the 
Internal process gamut storage unit 14 (S2203), and the 
gamut inside/outside determination unit 9 determines 
25 whether the image data which has undergone the color 
coordinate conversion falls inside or outside the 
internal process gamut (S2204). If the determination 
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result Indicates that the Image data falls within the 
internal process gamut , the flow jumps to step S2207; 
otherwise, the flow advances to step S2206 (S2205). 
If it is determined that the image data falls 
5 outside the internal process gamut, the color 

conversion unit 10 converts that image data into image 
data corresponding to a color of an inf ramarginal 
portion of the internal process gamut, and writes the 
converted data at a corresponding location on the data 

10 buffer 11 (S2206). It is then determined if image data 
to be processed corresponds to the last pixel of the 
input image data (S2207). If the image data to be 
processed does not correspond to the last pixel, the 
flow returns to step S2204. 

15 If the image data corresponds to the last pixel, 

the image processing unit 15 applies image processes 
such as gradation correction, color correction, and the 
like to the image data stored in the data buffer 11 
(S2208), and the gamut mapping unit 16 maps the 

20 internal process gamut to the gamut of the image output 
device 4 (S2209) . Then, the gamut -mapped image data is 
output to the image output device 4 via the image 
output unit 7 (S2210), thus ending the process. 
[Gamut Mapping] 

25 Pig. 17 is a flow chart showing the process for 

mapping the internal process gamut to the gamut of the 
image output device in step S2209. 
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Internal process gamut information is read from 
the internal process gamut storage unit 14 (S2301). 
This gamut information includes the LCh values of 3D 
information of the internal process gamut, as has been 
5 explained using Figs. 12A and 12B. The 3D information 
to be read out includes C values corresponding to 
maximum saturation levels in 10-step Increments of L 
and h values. Although not shown in Figs. 12A and 12B, 
the RGB values of an internal process color signal 
10 corresponding to these LCh values are also stored in 
the internal process gamut storage unit 14 , and are 
read in step S2301. 

The gamut information of the image output device 
4 is read from the image output device gamut storage. 
15 unit 17 (S2302). This gamut information includes 

L'C'h 1 values indicating the gamut of the image output 
device 4 as in the 3D information of the internal 
process gamut. The 3D information to be read out 
includes, for example, C f values corresponding to 
20 maximum saturation levels in 10-step increments of L' 
and h 1 values. Also, the R'G'B' values of an image 
output color signal corresponding to these L'C'h 1 
values are stored in the image output device gamut 
storage unit 17 , and are read out in step S2302. 
25 The LCh values of the internal process gamut and 

the L'C'h 1 values of the gamut of the image output 
device 4 are obtained for each lightness L value and 
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hue h value. The correspondence among the LCh values, 
L'C'h 1 values, RGB values , and R'G'B' values is 
determined to generate a 3D lookup table (3DLUT) 
(S2303). 

5 Using the 3DLUT, the gamut of ah Image to be 

processed is converted from the internal process gamut 
to the gamut of the image output device 4 (S2304), thus 
ending the process. 

In this manner, it is determined using black 

10 information and white information of the internal 

process gamut whether input color data falls inside or 
outside the internal process gamut, and the color data 
which falls outside the internal process gamut 
undergoes color conversion in accordance with the 

15 conversion method (and conversion condition) set by the 
user. Hence, a color that falls outside the internal 
process gamut can be converted, into a color on the 
inframarginal portion of the internal process gamut and 
can be further converted into the gamut of the image 

20 output device 4 while preserving its tincture as much 
as possible. 

Modification 

In the above embodiments, the color conversion 
25 into the XYZ value uses conversion equations with Y 
which normalized to 0 to 1. However, the present 
invention is not limited to such specific equations. 
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and Y may be normalized to 0 to 100. 

In the above embodiments , the color conversion 
method displayed on the interface window of Fig. 7 has 
been explained. However, the present invention is not 
5 limited to such specific color conversion method, and 
any other color conversion methods of user's choice may 
be used. Fig. 8 shows the conversion direction of each 
color conversion method, but the present invention is 
not limited to such specific conversion direction. The 
10 color after color conversion is that on the 

inframarginal portion of the gamut. Alternatively, a 
color may be converted into a color inside the gamut. 
Furthermore, the color coordinate system used in color 
conversion is not limited to the LCh coordinate system, 
15 and any other color systems may be used. In the above 
embodiments, D65 is used as white, but the present 
invention is not limited to this. 

In the above embodiments, the selection method 
using buttons has been exemplified as the user 
interface window shown in Fig. 7. However, the present 
invention is not limited to such specific selection 
method, and a user interface window with which the user 
selects using, e.g., a drop-down menu may be adopted. 
Also, a user interface window to which the user 
directly inputs keywords may be used. Furthermore, the 
user may select a color after color conversion on the 
color coordinate system. That is, the configuration of 
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the user Interface ±s not particularly limited as long 
as the user can make setups of his or her choice. 

In the above embodiments . the LCh values are 
stored as gamut information. However , the present 
5 invention is not limited to such specific information , 
and any other formats that can express a 3D gamut may 
be used. Also, the gamut information may be stored in 
accordance with a given format such as an * ICC profile 
or the like. 

0 

Fourth Embodiment 

Figs. 18A to 18D are block diagrams showing the 
arrangement of an image processing apparatus according 
to the fourth embodiment. Reference numeral 1001 

5 denotes an input -side image processing apparatus of the 
fourth embodiment; 1002, a display- side image 
processing apparatus of the fourth embodiment; 1003, an 
output-side image processing apparatus of the fourth 
embodiment; 1004, an image input device such as a 

3 digital camera, color scanner, or the like, which is 
used to input an image; 1005, an image display device 
such as a CRT, LCD, or the like, which is used to 
display an image; and 1006, an image output device such 
as a color printer or the like, which is used to output 

> an image. 

The internal arrangement of the input -side image 
processing apparatus 1001 will be explained first. 
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Reference numeral 1011 denotes an interface (I/F) unit 
which is used to exchange data between the input -side 
image processing apparatus 1001 and other apparatuses; 
1012, an image input unit for inputting image data 
input by the image input device 1004; 1013, a color 
coordinate conversion unit for performing color 
conversion between an image input device color space 
and color conversion work space, and color conversion 
between the color conversion work space, and a color 
expression space,- 1014, an image compression unit for 
compressing the input image to reduce the data size 
upon exchanging the image with other apparatuses; 1015, 
a color correction unit for performing color correction 
of the input image; 1016, a gradation conversion unit 
for performing gradation conversion of the input image; 
and 1017, a data buffer for temporarily holding image 
data for image data processes . Note that these . ° . • 
apparatus 1001 to 1003 are connected by a communication 
line 1007 such as a system bus, a local area network 
(LAN), a serial bus which conforms to or based on IEEE 
1394 standards or Universal Serial Bus (USB) standards, 
or the like. 

Next, the internal arrangement of the 
display-side image processing apparatus 1002 will be 
explained. Reference numeral 1021 denotes an I/F unit 
for exchanging data between the display-side image 
processing apparatus 1002 and other apparatuses; 1022, 
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an Image display unit for displaying Image data to be 
displayed on the Image display device 1005; 1023 , a 
color coordinate conversion unit for performing color 
conversion between an image display device color space 
5 and color conversion work space , and color conversion 
between the color conversion work space, and a color 
expression space; 1024, a color correction unit for 
performing color correction of the image; 1025, a 
gradation conversion unit for performing gradation 

10 conversion of the image; 1026, a gamut inside/outside 
determination unit for determining if a color falls 
inside/outside a gamut; 1027, a gamut compression unit 
for compressing the gamut; 1028, a data buffer for 
temporarily holding image data for Image data 

15 processes; 1029, an image compression/ expansion unit 
for compressing/expanding an image to reduce the data 
size upon exchanging the image with other apparatuses; 
1210, a user interface (UI) unit for allowing the user 
to make image process operations using the display- side 

20 image processing apparatus 1002; and 1211, a range 

information storage unit for storing range Information 
of the color conversion work space. 

The internal arrangement of the output -side image 
processing apparatus 1003 will be explained below. 

25 Reference numeral 1031 denotes an I/F unit for 
exchanging data between the output -side Image 
processing apparatus 1003 and other apparatuses; 1032, 
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an image output unit for outputting ±mage data to be 
output by the image output device 1006; 1033 , a color 
coordinate conversion unit for performing color 
conversion between a color conversion work space and 
5 color expression space; 1034 , a color correction unit 
for performing color correction of the image; 1035 r a 
gradation conversion unit for performing gradation 
conversion of the image; 1036, a color separation unit; 

1037 , a gamut in side /out side determination unit for 
10 determining if a color falls inside/outside a gamut; 

1038, a gamut compression unit for compressing the 
gamut; 1039, a data buffer for temporarily holding 
image data for image data processes; 1310, an output 
gamut data storage unit for storing gamut information 

15 of the image output device 1006; 1311, an image 
expansion unit for expanding an image input from 
another apparatus; and 1312 , a range information 
storage unit for storing range information of the color 
conversion work space. 

20 [Overall Processing] 

Pig. 19 is a flow chart of image processes 
executed by the input- side image processing apparatus 
1001, display-side image processing apparatus 1002, and 
output -side image processing apparatus 1003. The color 

25 conversion processes executed in the input-side image 
processing apparatus 1001, display-side image 
processing apparatus 1002, and output-side image 
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processing apparatus 1003 will be described in detail 
below using the flow chart of Fig. 19* In step S1201, 
the input-side image processing apparatus 1001 executes 
image processes. In step S1202, the display-side image 
5 processing apparatus 1002 executes image processes. In 
step S1203, the output-side image processing apparatus 
1003 executes image processes, thus ending the 
processes. 

[Process in Input-side Image Processing Apparatus] 
10 Fig. 20 is a flow chart for explaining the image 

processes executed in the input-side image processing 
apparatus 1001 in step S1201. A detailed explanation 
will be given below using the flow chart of Fig. 20. 

In step S1301, the image input Unit 1012 inputs 
15 an image using the image input device 1004. In step 
S1302, the input image data is written in the data 
buffer 1017. In step S1303, the color coordinate 
conversion unit 1013 performs color coordinate 
conversion from an input device color space RIGiBi (RGB 
20 values normalized to 0 to 1) into a color conversion 
work space RIGIBI (RGB values normalized to 0 to 1) 
used to execute the color conversion process Inside the 
input -side image processing apparatus 1001. This 
conversion uses: 
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Note that coefficients all to a33 in equation (11) are 
determined in advance. 

The input device color space RiGiBi includes a 
color signal having color characteristics unique to the 
5 image input device 1004, and the color conversion work 
space RIGIBI includes a color signal having a gamut 
that contains those of image input /output devices, and 
is defined by: 
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10 The color conversion work space may use Rl'Gl'Bl' as 
values after gamma conversion of RIGIBI. 

In step S1304, the gradation conversion unit 1016 
executes gradation correction process for correcting 
gradation characteristics unique to the image input 
15 device 1004, and converting input image data into 

desired gradation characteristic data. In step S1305, 
the color correction unit 1015 executes color 
correction processes for correcting color 
characteristics unique to the image input device 1004, 
20 and converting input image data into desired color 
characteristic data. In step S1306, the color 
coordinate conversion unit 1013 performs a color 
coordinate conversion process from the color conversion 
work space RIGIBI onto a color expression space scRGB 
25 used to exchange data with other apparatuses. Note 
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that the color expression space scRGB can express a 
whole visual range. . This conversion uses equations 



(13) to (15) 
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Note that equation (13) is an inverse conversion 
equation of equation (12). 
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The color expression space scRGB (relative scene 
RGB color space) given by equation (14) adopts D65 as a 
white reference point. When the color conversion work 
space R1G1B1 has a white reference point other than 
D65, XYZ data undergo a white conversion process to D65 
by: 



^scRGB(16) = ^sc 

(16) = G soRGB x 8192 + 4096 ...(15) 
- 8 crgb(i6) = B SCRGB x 8192 + 4096 
before conversion of equation (14). 

In step SI 3 07 # the image compression unit 1014 
compresses the image data to reduce the transfer load 
upon exchanging the image with other apparatuses. In 
step S1308, the I/P unit 1011 outputs the image to 
other apparatuses, thus ending the process. 
[Process in Display-side Image Processing Apparatus] 

Fig. 21 is a flow chart for explaining the image 
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processes executed in the display- side image processing 
apparatus 1002 in step S1202. A detailed explanation 
will be given below using the flow chart of Pig. 21. 

In step S2401, the image input unit 1021 inputs 
5 an image. In step S2402, the input image data is 

written in the data buffer 1028. In step S2403, the 
image compression/expansion unit 1029 expands the input 
compressed image data. In step S2404, the color 
coordinate conversion unit 1023 performs color 

10 coordinate conversion from the color expression space 
scRGB into a color conversion work space R1G1B1 (RGB 
values normalized to 0 to 1) used to execute the color 
conversion process in the display-side image processing 
apparatus 1002. This conversion uses equation (12) 

15 and: 

^SCRGB = ^scRGB(16)/®^-^2 — 0.5 

/8192 - 0.5 . . . (16) 



Bscrgb = B acRGB(16 j/8192 - 0.5 
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20 Note that the color conversion work space may use 

Rl'Gl'Bl' as values after gamma conversion of R1G1B1. 
In step S2405, range information of the color 
conversion work space is read out from the range 
information storage unit 1211. The gamut 

25 inside/outsiae determination unit 1026 determines in 
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step S2406 whether the color signal that has undergone 
color coordinate conversion in step S2404 falls inside 
or outside the color conversion work space range. It 
is checked in step S2407 whether or not the 
5 determination result in step S2406 indicates inside the 
range. If the determination result Indicates inside 
the range, the flow jumps to step S2409; otherwise, the 
flow advances to step S2408. 

In step S2408, the gamut compression unit 1011 

10 compresses the color .signal, which is determined in 
step S2406 to fall outside the color conversion work 
space range, to the inframarginal portion of the color 
conversion work space range. It is then determined in 
step S2409 if a pixel to be processed is the last pixel 

15 of the input image data. If the pixel to be processed 
is not the last pixel, the flow returns to step S2406; 
otherwise, the flow advances to step S2410. In step 
S2410, the gradation conversion unit 1025 and color 
correction unit 1024 respectively execute the . gradation 

20 conversion process and color correction process for 
converting image data into desired gradation 
characteristic data and desired color characteristic 
data. It is checked in step S2411 if the processed 
image data is to be displayed on the image display 

25 device 1005. If the image data is to be displayed, the 
flow advances to step S2415; otherwise, the flow 
advances to step S2412. 
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In step S2412, the color coordinate conversion 
unit 1023 executes the color coordinate conversion 
process from the color conversion work space R1G1B1 
into the color expression space scRGB used to exchange 
5 data with other apparatuses. This conversion uses 

equations (13) to (15). As described above , the color 
expression space scRGB given by equation (14) adopts 
D65 as a white reference point. When the color 
conversion work space R1G1B1 has a white reference 
10 point other than D65, XYZ data undergo a white 

conversion process to D65 before conversion of equation 
(14). In step S2413, the image compression/expansion 
unit 1029 compresses image data to reduce the transfer 
load upon exchanging the image with other apparatuses. 
15 In step S2414, the I/F unit 1021 outputs the image to 
other apparatuses, thus ending this process. In step 
S2415, the color coordinate conversion unit 1023 
executes the color coordinate conversion process from 
the color conversion work space R1G1B1 into an image 
20 display device color space RdGdBd. This conversion 
uses: 
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In step S2416, the image display unit 1022 
displays the image using the image display device 1005, 
25 thus ending this process. 
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[Process In Output -side Image Processing Apparatus] 

Fig. 22 is a flow chart for explaining the image 
processes executed in the output-side image processing 
apparatus 1003 in step S1203. A detailed explanation 
5 will be given below using the flow chart of Fig. 22. 

In step S2501, the I/F unit 1031 inputs an image. 
In step S2502, the input image data is written in the 
data buff er 1039. In step S2503, the image expansion 
unit 1311 expands the input compressed Image data. In 
step S2504, the color coordinate conversion Unit 1033 
performs color coordinate conversion from the color 
expression space scRGB into a color conversion work 
space R1G1B1 (RGB values normalized to 0 to 1) used to 
execute the color conversion process in the output -side 
image processing apparatus 1003. This conversion uses 
equations (16) to (17) , and equation (12). Note that 
the color conversion work space may use Rl'Gl'Bl 1 as 
values after gamma conversion of R1G1B1. 

In step S2505, range information of the color 
conversion work space is read out from the range 
information storage unit 1312. The gamut 
inside/outside determination unit 1037 determines in 
step S2506 whether the color signal that has undergone 
color coordinate conversion in step S2504 falls inside 
or outside the color conversion work space range. It 
is checked in step S2507 whether or not the 
determination result in step S2506 indicates inside the 
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range . If the determination result indicates Inside 
the range, the flow jumps to step S2509; otherwise, the 
flow advances to step S2508. In step S2508, the gamut 
compression unit 1038 compresses the color signal, 
5 which is determined in step S2506 to fall outside the 
color conversion work space range, to the inframarginal 
portion of the color conversion work space range. It 
is then determined in step S2509 if a pixel to be 
processed is the last pixel of the input image data. 

10 If the pixel to be processed is not the last pixel , the 
flow returns to step S2506; otherwise, the flow 
advances to step S2510. 

In step S2510, the gradation conversion unit 1035 
and color correction unit 1034 respectively execute the 

15 gradation conversion process and color correction 
process for converting image data into desired 
gradation charact eristic data and desired color 
characteristic data. In step S2511, the color 
conversion work space R1G1B1 undergoes gamut 

20 compression to an output device color space RoGoBo. 

The gamut compression uses a conversion table stored in 
the output gamut data storage unit 1310. This 
conversion table is, e.g., a 3D LUT. In step S2512, 
the color separation unit 1036 separates the output 

25 device color space RoGoBo into color signals unique to 
the output device. In step S2513, the gradation 
conversipn unit 1035 executes a gradation conversion 
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process such as halftoning or the like. In step S2514, 
the Image output unit 1032 outputs the Image using the 
Image output device 1006, thus ending this process. 
[Read Range Information of Color Conversion Work Space] 
5 Fig. 23 Is a flow chart of the process for 

reading but the range information of the color 
conversion work space from the range information 
storage units 1211 and 1312 in steps S2405 and S2505. 
A detailed expleuaation will be given using the flow 

10 chart of Fig. 23. 

In step S1601, the RGB values of black as the 
lower limit values of the color conversion work space 
are read from the range information storage unit 1211 
(1312) and are set in Rk, Gk, and Bk. In step S1602, 

15 the RGB values of white as the upper limit values of 

the color conversion work space are read from the range 
information storage unit 1211 (1312) and are set in Rw, 
Gw, and Bw. In step S1603, 3D information (LCh values) 
of the color conversion work space are read, thus 

20 ending the process. 

Figs. 27A and 27B show the RGB values of black 
information and white information of the color 
conversion work space and the LCh values of 3D 
lnf ormation of the color conversion work space as an 

25 example of the color conversion work space information 
stored in the range information storage units 1211 and 
1312. For example, black information is expressed by R 
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« 0.0, B =0.0, and B = 0.0, and white information is 
expressed by R = 1.0, G = 1.0, and B = 1.0. As the 3D 
information, after XYZ values obtained by equation (13) 
using the RGB values ranging from (0.0, 0.0, 0.0) to 
5 (1.0, 1.0, 1.0) are multiplied by 100, equations (19.1) 
to (19.4) (using D65 as white) and equation (20) are 
used to calculate LCh values based on those XYZ values 
and, for example, C values corresponding to maximum 
saturation levels in 10-step increments of L and h 
10 values are stored. As the 3D information, for example, 
C values corresponding to maximum saturation levels in 
10-step increments of L and h values are stored, 
if Y/Yn > 0.008856, 

L* = 116(Y/Yn) 1/3 - 16 ...(19.1) 
15 if Y/Yn 0.008856, 

L* = 903.29(Y/Yn) ...(19.2) 
where Y: the Y value of a tristimulus value on the XYZ 
color system 

Yn: the Y value based on standard light of a 
20 perfect reflecting diffuser 

a* = 500[f(X/Xn) - f(Y/Yn)] 

b* = 200[f(X/Xn) - f(Z/Zn)] ...(19.3) 

for 

if X/Xn > 0.008856, 
25 f (X/Xn) = (X/Xn) 1/3 

if X/Xn <; 0.008856, 
f(X/Xn) - 7.78(X/Xn) + 16/116 
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if Y/Yn > 
f(Y/Yn) - 
if Y/Yn £ 
f(Y/Yn) = 
5 If Z/Zn > 

f (Z/Zh) 
if Z/Zn s: 
f (Z/Zn) - 
Note that 

10 since D65 is used as white. Next, the Lab values are 
converted into LCh values using: 

C'e,, = V(a* 2 + b* 2 ) ... (20) 

h ab « tan l (b*/a*) 
[Inside /out side Determination Process of Color 
15 Conversion Work Space Range] 

Fig. 24 is a flow chart showing the process 
executed in the gamut inside/outside determination 
units 1026 and 1037 to determine in steps S2406 and 
S2506 Whether a color signal falls inside or outside 
20 the color conversion work space range. A detailed 
explanation will be given using the flow chart of 
Pig. 24. 

A gamut inside/outside determination flag OUT is 
initialized in step S1701. It is checked in step S1702 
25 if the R value of a pixel to be processed is smaller 
than the lower limit value Rk of the color conversion 
work space. If R < Rk, the fiow advances to step 



0.008856, 

(Y/Yn) l/3 ...(19.4) 
0.008856, 

7.78(Y/Yn) + 16/116 
0.008856, 

(Z/Zn) 1/3 
0.008856, 

7.78(Z/Zn) + 16/116 

Xn = 95.05, Yn = 100.0, and Zn = 108.91 
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S1708; otherwise, the flow advances to step S1703. It 
Is checked in step S1703 if the G value of the pixel to 
be processed is smaller than the lower limit value Gk 
of the color conversion work space. If G < Gk, tlie 
5 flow advances to step S1708; otherwise, the flow 

advances to step S1704. It is checked in step SI 704 if 
the B value of the pixel to be processed is smaller 
than the lower limit value Bk of the color conversion 
work space* If B < Bk, the flow advances to step 
10 S1708; otherwise, the flow advances to step S1705. It 
is checked in step S1705 if the R value of the pixel to 
be processed is larger than the upper limit value Rw of 
the color conversion work space. If R > Rw, the flow 
advances to step S1708; otherwise, the flow advances to 
15 step S1706. It is checked in step S1706 if the G value 
of the pixel to be processed is larger than the upper 
limit value Gw of the color conversion work space. If 
G > Gw, the flow advances to step S1708; otherwise, the 
flow advances to step S1707. It is checked in step 
20 S1707 if the B value of the pixel to be processed is 
larger than the upper limit value Bw of the color 
conversion work space. If B > Bw, the flow advances to 
step S1708; otherwise, the process ends. In step 
S1708, f l' indicating outside the gamut is set in the 
25 gamut inside/outside determination flag OUT, thus 
ending the process. 

[Color Conversion into Color Conversion Work Space] 
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Fig. 25 Is a flow chart of the gamut compression 
executed by the gamut compression units 1027 and 1038 
to convert a color signal which is determined ' to fall 
outside the color conversion work space to the 

5 inf ramarginal portion of the color conversion work 

space in steps S2408 and S2508. A detailed explanation 
will be given using the flow chart of Fig. 25. 

In step S1801, the R1G1B1 values of the color 
conversion work space color signal are converted into 

10 XYZ values using equation (13). In step S1802, the XYZ 
values are respectively multiplied by 100 tb adjust the 
scale (since the calculation results of the above 
equations are scaled so that Y falls within the range 
from 0 to 1). In step S1803, the XYZ values are 

15 converted into Lab values using equations (i9.1) to 

(19.4). The conversion in step S1803 uses Rn = 95.05, 
Gn = 100.0, and Bn = 108.91 since D65 is used as white. 
In step S1804, the Lab values are converted into LCh 
values using equation (20). 

20 In step S1805, the user interface shown in Fig. 7 

is presented to set a color conversion method. On a 
color conversion method setup window 601, a basic color 
conversion method is set using a basic setup window 602 
used to select. When the user wants to set the color 

25 conversion method in more detail (to set a preferential 
conversion method in addition to the basic setup), he 
or she checks a detailed setup check box 603 and makes 
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detailed setups on a detailed setup window 604. Note 
that "hue preservation conversion" is set as basic 
color conversion , and "gradation preference" is set as 
another preferential setup in Pig. 7. Upon completion 
5 of the setups , the user presses an OK button 605. If 
the user. wants to cancel the setups, he or she presses 
a cancel button 606. 

In step S1806, color conversion is performed in 
accordance with the color conversion method set in step 

10 S1805. Fig. 26 shows the color conversion process 

executed in step S1806, and shows a color conversion 
direction when "hue preservation" is selected as the 
basic color conversion method. Note that the ordinate 
plots lightness L, and the abscissa plots saturation C 

15 and also a color conversion work space 3000 read in - 

steps S2405 and S2505. When "saturation preference" is 
selected on the detailed setup window 604, an input 
color 3001 is converted into a color on an 
inframarginal portion 3002 of the color conversion work 

20 space so as not to change saturation. When "color 
difference preference" is selected, the input color 
3001 is converted into a color on an inframarginal 
portion 3003 of the color conversion work space so as 
to minimize the color difference. When "gradation 

25 preference" is selected, the input color 3001 is 

converted into a color on an inframarginal portion 3004 
of the color conversion work space so as not to change 



WO 2004/028143 PCT/JP2003/011047 

- 50 - 



gradation. When "lightness preference" is selected, 
the input color 3001 Is converted into a color on em 
inframarginal portion 3005 of the color conversion work 
space so as not to change lightness. 
5 In step S1807, the LCh values are converted into 

Lab values using the inverse conversion equation of 
equation (20). In step S1808, the Lab values are 
converted into XYZ values using the inverse conversion 
equations of equations (19.1) to (19.4). In step 

10 S1809, the XYZ values are divided by 100 to set the 
original scale. In step S1810, the XYZ values are 
converted into R1G1B1 values of the color conversion 
work space signal , thus ending the process. 

As described above , according to the fourth 

15 embodiment, upon exchanging image data among color 

image input /output devices or in image processes such 
as color conversion and the like, the color expression 
space that can express the whole visual range is used 
to exchange image data between the devices/ and the 

20 color conversion work space that includes the gamut of 
the device is independently used in the color 
conversion process inside the device. Hence, the image 
input device, image display device, and image output 
device can exchange data of the visual range, and can 

25 execute color conversion suited to each individual 
device . 
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Fifth Embodiment 

Fig. 28 is a block diagram showing the 
arrangement of the input -side image processing 
apparatus 1001 and the output -side image processing 
5 apparatus 1003 according to the fifth embodiment. 

Since the names and functions of the respective units 
are the same as those in the fourth embodiment, a 
description thereof will be omitted. The difference 
from the fourth embodiment is that this embodiment 
10 comprises only the input -side image processing 
apparatus 1001 and output-side image processing 
apparatus 1003. 
[Overall Processing] 

Fig. 29 is a flow chart of image processes 
15 executed by the input-side image processing apparatus 
1001 and output-side image processing apparatus 1003. 
The color conversion processes executed in the 
input- side image processing apparatus 1001 and 
output-side image processing apparatus 1003 will be 
20 described in detail below using the flow chart of 
Fig. 29. In step S2301, the input -side image 
processing apparatus 1001 executes image processes. In 
step S2302, the output-side image processing apparatus 
1003 executes image processes, thus ending the 
25 processes. Note that the processing contents in step 
S2301 are the same as those in step S1201, and the 
processing contents in step S2302 are the same as those 
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In step S1203. 

As described above , according to the fifth 
embodiment , upon exchanging Image data between color 
image input /output devices or in image processes such 
5 as color conversion and the like, the color expression 
space that can express the whole visual range is used 
to exchange image data between the devices , and the 
color conversion work space that includes the gamut of 
the device is independently used in the color 
10 conversion process inside the device. Hence , the image 
input device and image output device can exchange data 
of the visual range, and can execute color conversion 
suited to each individual device . 

15 Sixth Embodiment 

Figs. 30A to 30D are block diagrams showing the 
arrangement of the input -side image processing 
apparatus 1001, display-side image processing apparatus 
1002, and output-side image processing apparatus 1003. 

20 A description of units which have the same names and 
functions as those in the fourth embodiment will be 
omitted. 

The internal arrangement of the input -side image 
processing apparatus 1001 will be described first. 
25 Reference numeral 1018 denotes a color space 

information setting unit for setting a color conversion 
work space used inside the input -side image processing 
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apparatus 1001; and 1019, a UI unit for allowing the 
user to set color space information. 

The internal arrangement of the display- side 
image processing apparatus 1002 will be described 
5 below. Reference numeral 1210 denotes a UI unit for 
allowing the user to set color space information; and 
1212, a color space information setting unit for 
setting a color conversion work space used inside the 
display-side image processing apparatus 1002. 

10 The internal arrangement of the output- side image 

processing apparatus 1003 will be described below. 
Reference numeral 1313 denotes a color space 
information setting unit for setting a color conversion 
work space used inside the output-side image processing 

15 apparatus 1003; and 1314, a UI unit for allowing the 
user to set color space information. 
[Overall Processing] 

Fig. 31 is a flow chart of image processes 
executed by the input -side image processing apparatus 

20 1001, display-side image processing apparatus 1002, and 
output-side image processing apparatus 1003. The color 
conversion processes executed in the input -side image 
processing apparatus 1001, display-side image 
processing apparatus 1002, and output-side image 

25 processing apparatus 1003 will be described in detail 
below using the flow chart of Pig. 31. 

In step S2501, the color space information 
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setting unit 1018 sets a color expression space used to 
exchange data with other apparatuses, and a color 
conversion work space used Inside the Input -side Image 
processing apparatus 1001. In step S2502, the 
5 Input-side Image processing apparatus 1001 executes 
image processes. In step S2503, the color space 
information setting unit 12i2 sets a color expression 
space used to exchange data with other apparatuses, and 
a color conversion work space used Inside the 
10 display-side image processing apparatus 1002. In step 
S2504, the display- side image processing apparatus 1002 
executes image processes. In step S2505, the color 
space information setting unit 1313 sets a color 
expression space used to exchange data with other 
15 apparatuses, and a color conversion work space used 

inside the output-side image processing apparatus 1003. 
In step S2506, the output-side image processing 
apparatus 1003 executes image processes, thus ending 
the process. Note that the processing contents in step 
20 S2502 are the same as those in step S1201, the 

processing contents in step S2504 are the same as those 
in step S1202, and the processing contents in step 
S2506 are the same as those in step S1203. 
[Color Space Information Setup User Interface] 
25 Fig. 32 shows an example of a user interface used 

when the user sets a color expression space used to 
exchange data with other apparatuses, and a color 
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conversion work space used inside the respective image 
processing apparatuses using the color space 
information setting units 1018, 1212, and 1313. On a 
color expression space setup window 1602 •, a color 
5 expression space used to exchange data with other 

apparatuses is set. In this case, as examples of the 
color expression space, sRGB, scRGB, bg-sRGB, and a 
color space which can be customized by the user are 
presented, and scRGB is selected as the color 
10 expression space. On a color conversion work space 

setup window 1603, a color conversion work space used 
in each image processing apparatus is set. In this 
case, as examples of the color conversion work space, 
sRGB, RGB2, RGB3, RGB4, and RGB 5 are presented, and 
15 RGB 2 is selected as the color conversion work space. 
Upon completion of the setups, the user presses an OK 
button 1604. If the user wants to cancel the setups, 
he or she presses a cancel button 1605. 

As described above, according to the sixth 
20 embodiment, upon exchanging image data among color 

image input /output devices or in image processes such 
as color conversion and the like, the user can 
individually set a color expression space used to 
exchange image data between the devices , and a color 
25 conversion work space used in the color conversion 
process inside the device. 
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Seventh Embodiment 

Fig. 33 shows an example of image data to be 
exchanged among the input-side image processing 
apparatus 1001, display-side image processing apparatus 
5 1002, and output-side image processing apparatus 1003. 
The color expression space information and color 
conversion work space information set in the fourth to 
sixth embodiments are appended to image data, and the 
processes in each linage processing apparatus use the 

10 appended Information to execute color conversion 
processes. As the information to be appended, the 
color expression space information includes definition 
equations (14) to (17) or their coefficients, and the 
color conversion work space information includes 

15 definition equations (12) and (13), their coefficients, 
or Information shown in Figs. 27A and 27B. 

As described above , according to the seventh 
embodiment , upon exchanging image data among color 
image input /output devices or in image processes such 

20 as color conversion and the like, a color expression 
space used to exchange image data between the devices , 
and a color conversion work space used in the color 
conversion process inside the device can be 
individually set by appending them to an image. 

25 <Other Embodiment > 

The present invention can be applied to a system 
constituted by a plurality of devices (e.g., host 
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computer, interface, reader, printer) or to an, 
apparatus comprising a single device (e.g.,,. copying 
machine, facsimile machine)* - 
Further, the object of the present invention can 
5 also be achieved by providing a storage medium storing 
program codes for performing the aforesaid processes to 
a computer system or apparatus (e.g., a personal 
computer), reading the program codes, by a CPU or MPU 
of the computer system or apparatus, from the storage 
10 medium, then executing the program. 

In this case, the program codes read from the 
storage medium realize the functions according to the 
embodiments, and the storage medium storing the program 
codes constitutes the invention. 
15 Further, the storage medium, such as a floppy 

disk, a hard disk, an optical disk, a magneto -optical 
disk, CD-ROM, CD-R, a magnetic tape, a non-volatile 
type memory card, and ROM can be used for providing the 
program codes. 
20 Furthermore, besides aforesaid functions 

according to the above embodiments are realized by 
executing the program codes which are read by a 
computer, the present invention Includes a case where 
an OS (operating system) or the like working on the 
25 computer performs a part or entire processes in 

accordance with designations of the program codes and 
realizes functions according to the above embodiments. 
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Furthermore, the present invention also Includes 
a case where, after the program codes read from the 
storage medium are written in a function expansion card 
which is inserted into the computer or in a memory 
5 provided in a function expansion unit which is 

connected to the computer, CPU or the like contained in 
the function expansion card or unit performs a part or 
entire process in accordance with designations of the 
program codes and realizes functions of the above 

10 embodiments. 

As many apparently widely different embodiments 
of the present invention can be made without departing 
from the spirit and scope thereof , it is to be 
understood that the invention is not limited to the 

15 specific embodiments thereof except as defined In the 
claims . 
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CLAIMS 

1. An Image processing method of processing Image 
data between devices which input /output an image, 
comprising the steps of: 

5 inputting image data; 

determining whether or not the input image data 
falls outside the human visible range; and 

converting the image data which is determined to 
fall outside the range to a color on an inf ramarginal 
10 portion of or inside the range. 

2. The method according to claim 1, wherein the 
human visible range is a region in the xy chroraaticity 
diagram, which is surrounded in a spectrum locus and a 
purple boundary. 

15 3. The method according to claim 1, further 

comprising the step of setting a conversion method of 
the conversion. 

4. The method according to claim 4, wherein one of 
color difference minimization, lightness preservation, 

20 hue preservation, and saturation preservation is 
selectable as the conversion method. 

5 . The method according to claim 4 , further 
comprising the step of setting a conversion condition 
of the conver s ion . 

25 6. The method according to claim 6, wherein one of 
saturation preference, color difference preference, 
gradation preference, and lightness preference is 
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selectable as the conversion condition. 

7 . An image processing apparatus for connecting 
image input /output devices, comprising: 

an inputting section, arranged to input image 

5 data; 

a determiner, arranged to determine whether or 
not the input image data falls outside the human 
visible range; and 

a converter, arranged to convert the image data 
0 which is determined to fall outside the range to a 
color on an inframarginal portion of or inside the 
range. 

8. A computer program for an image processing method 
of processing image data between devices which 
input /output an image, the method comprising the steps 
of: 

inputting image data; 

determining whether or not the input image data 
falls outside the human visible range; and 

converting the image data which is determined to 
fall outside the range to a color on an inframarginal 
portion of or inside the range. 

9. A computer program product storing a computer 
readable medium comprising a computer program code, for 
an image processing method of processing image data 
between devices which input /output an image, the method 
comprising the steps of: 
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inputting image data; 

determining whether or not the input image data 
falls outside the human visible range; and 

converting the image data which is determined to 
5 fall outside the range to a color on an inf ramarginal 
portion of or inside the range . 

10. An image processing method, comprising the steps 
of: 

inputting a color data represented by a first 
10 color space which includes the human visible range; 

converting the input color data into a second 
color space for a color conversion process which 
includes a gamut of a first device; 

performing the color conversion process on the 
15 color data converted into the second color space; and 
converting the color data, which has undergone 
the color conversion process, into the first color 
space, and outputting the color data converted into the 
first color space* 
20 11. The method according to claim 10, wherein the 

color conversion process determines whether or not the 
color data converted into the second color space is 
included in a gamut of the second color space for the 
color conversion process. 
25 !2. The method according to claim 10, wherein the 
color data converted in to the first color space is 
outputted to a second device. 
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13. An Image processing apparatus, comprising: 

an inputting section, arranged to input a color 
data represented by a first color space which includes 
the human visible range; 
5 a first converter, arranged to convert the input 

color data into a second color space for a color 
conversion process which includes a gamut of a first 
device; 

a processor, arranged to perform the color 
10 conversion process on the color data converted into the 
second color space; and 

a second converter, arranged to convert the color 
data, which has undergone the color conversion process, 
into the first color space, and to output the color 
15 data converted into the first color space. 

14. A computer program for an image processing 
method, the method comprising the steps of: 

inputting a color data represented by a first 
color space which includes the human visible range; 

20 converting the input color data into a second 

color space for a color conversion process which 
includes a gamut of a first device; 

performing , the color conversion process on the 
color data converted into the second color space; and 

25 converting the color data, which has undergone 

the color conversion process, into the first color- 
space, and outputting the color data converted into the 
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first color space. 

15. A computer program product storing a computer 
readable medium comprising a computer program code, for 
an image processing method, the method comprising the 
5 steps of: 

inputting a color data represented by a first ' 
color space which includes the human visible range; 

converting the input color data into a second 
color space for a color conversion process which 
10 includes a gamut of a first device; 

performing the color conversion process on the 
color data converted into the second color space; and 

converting the color data, which has undergone 
the color conversion process, into the first color 
15 space, and outputting the color data converted into the 
first color space. 
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